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Abstract — One major open problem in network coding is 
to characterize the capacity region of a general multi-source 
multi-demand network. There are some existing computational 
tools for bounding the capacity of general networks, but their 
computational complexity grows very quickly with the size of 
the network. This motivates us to propose a new hierarchical 
approach which finds upper and lower bounding networks of 
smaller size for a given network. This approach sequentially 
replaces components of the network with simpler structures, 
i.e., with fewer links or nodes, so that the resulting network 
is more amenable to computational analysis and its capacity 
provides an upper or lower bound on the capacity of the original 
network. The accuracy of the resulting bounds can be bounded 
as a function of the link capacities. Surprisingly, we are able to 
simplify some families of network structures without any loss in 
accuracy. 

I. Introduction 

Finding the network coding capacity of networks with gen- 
eral topologies and communication demands is a challenging 
open problem, even for networks consisting of noiseless point- 
to-point links. Information theoretic inequalities can be used 
to bound network capacities, but it is in general a complex 
task to find the best combination of inequalities to apply. 
While various bounds (e.g. [1], [2], [2], [3]) can be obtained 
by clever choices of inequalities, we would like to have 
systematic general techniques for bounding the capacity in 
arbitrary network problems. We hope to derive these bounds 
in a way that allows us to bound the accuracy of the obtained 
bounds and to trade off tightness and computation. The LP 
outer bound [4], which gives the tightest outer bound implied 
by Shannon-type inequalities and has been implemented as the 
software programs Information Theoretic Inequalities Prover 
(ITIP) [5] and XITIP [6], has complexity exponential in 
the number of links in the network and can thus only be 
used to compute capacity bounds for relatively small problem 
instances. Inner bounds can be obtained by restricting attention 
to scalar linear, vector linear or abelian codes e.g. [7], [8], but 
the complexity of such approaches also grows quickly in the 
network size. This motivates us to seek systematic tools for 
bounding the capacity of a network by the capacity of another 
network with fewer links and characterizing the difference in 
capacity. 

In this paper we introduce a novel approach for analyzing 
capacity regions of acyclic networks consisting of capacitated 
noiseless links with general demands. Inspired by [9], we 
employ a hierarchical network analysis that replaces pieces 



of the network by equivalent or bounding models with fewer 
links. At each step of the process, one component of the 
network is replaced by a simpler structure with the same 
inputs and outputs. The model is an upper bounding model 
if all functions that can be implemented across the original 
network can also be implemented across the model. The 
model is a lower bounding model if all functions that can 
be implemented across that model can also be implemented 
across the given component. If the same model is both an 
upper bounding model and a lower bounding model for a given 
component, then the component and its model are equivalent. 
Where possible, we try to find upper and lower bounds that 
have identical structures, since bounding the accuracy of the 
resulting capacity bounds is easier when the topologies of the 
upper and lower bounding networks match. 

The organization of this paper is as follows. Section II 
describes the system model. The problem of finding equivalent 
or bounding networks of smaller size and the properties of 
such networks is discussed in Section III. Sections IV and 
V describe a variety of operations for finding such networks. 
Section VI treats accuracy bounds. The networks considered 
in this paper are assumed to be acyclic. The effect of cycles 
and delay is discussed in Section VII. Finally, Section VIII 
concludes the paper. 

II. System model 

We mainly use the model and notation introduced in [10]. 
The network is modeled by an acyclic directed graph 5\£ = 
(V ,£), where V and £ C V x V denote the set of nodes 
and links, respectively. Each directed link e = (vi,V2) G £ 
represents a noiseless link of capacity C e between the nodes 
vi and V2 in 'hi . For each node v, let In(v) and Out(v) denote 
the set of incoming and outgoing links of node v respectively. 

We assume that the source nodes (5) and sink nodes (T) 
are distinct, i.e., S f]T =0, and each source (sink) node 
has only outgoing (incoming) links. There is no loss of 
generality in this assumption since any network that violates 
these conditions can be modified to form a network that 
satisfies these conditions and has the same capacity. After these 
modifications, each node v G 1> falls into one of the following 
categories: i) source nodes (5), ii) sink nodes {1) and iii) relay 
nodes (/). Relay nodes have both incoming and outgoing links, 
and they do not observe any external information. Their role 
is to facilitate data transfer from the source nodes to the sink 
nodes. 



A subnetwork = (o^Ej) of network 5\£ = (^,E) is 
constructed based on a subset of relay nodes 7 V C / as follows. 
The set of sources and sinks of the subnetwork 2\£s are defined 
as S s = {v S <V : v ^ /j,3v' G / s ,(v,v') «}, and T x = {v£ 
^ : v £ Z,,3v' 6 / s ,(v',v) G £}. Then, V s = 5,1)^0^. and 

■ = {e G £ : e = (v,v'),v,v' G 1^,}. 

A coding scheme of block length n for this network is 
described as follows. Each source node s£5 observes some 
message M s G X s = {1,2, . . . ,2" Rs }. Each sink node t G T 
is interested in recovering some of the messages that are 
observed by source nodes. Let p(f) C s denote the set of 
source nodes that the node t is interested in recovering. The 
coding operations performed by each node can be categorized 
as follows 

1) Encoding functions performed by the source nodes: 
For each s G S, and e 6 Out(s), the encoding function 
corresponding to link e is described as 

g e :X s ^{l,2,---,2 nCe }- (1) 

2) Relay functions performed at realy nodes: If v ^ S [_}T, 
then for each e G Out(v), the relay function correspond- 
ing to the link e is described as 

g e : J] {1,2,...,2' IC >}^{1,2,...,2"^}. (2) 

e'eln(v) 

3) Finally, for each t G T, and each s G P(?X a decoding 
function is defined as 

gf: n {1,2,-.., 2 nC <}^X s . (3) 

eeln(r) 

A rate vector R corresponding to the set {Z^}^ is said to 
be achievable on network 9\[ , if for any £ > 0, there exists n 
large enough and a coding scheme of block length n such that 
for all t G T and s G p(f) 

P(i#i° ^Z s )<e, (4) 

where M^' denotes the reconstruction of message M, at node 
f . Let H_ (9\[ ) denote the set of achievable rates on network 5\£ . 

Throughout the paper, vectors are denoted by bold upper- 
case letters, e.g. A, B, etc. Sets are denotes by calli- 
graphic upper-case letters, e.g. A, S, etc. For a vector A = 
(a i ,A2, ■ ■ ■ , a n) of length n and a set F C {1,2,...,«}, A y 
denotes a vector of length | f | formed by the elements of the 
vector A whose indices are in the set J in the order they show 
up in A. 

III. Equivalent and bounding networks 

The problem we consider is defined formally as follows. For 
a given network $1 , we wish to find a network 9\[ ' with fewer 
links for which the set of achievable rates either bounds %_{H,) 
from below (X(5\£') C bounds ^.(5\£) from above 

<X {K ) Q 00 or describes it perfectly (%.{$(.)= H{$C '))■ 
We take a hierarchical approach, sequentially applying op- 
erations to simplify the given network. Following [9], each 
operation replaces a subnetwork of the network with a bound- 
ing model. Subnetwork 9(2 is an upper bounding model for a 



subnetwork 5\£i with the same number of input (source) and 
output (sink) nodes (written 5\£i C 9Y2) if all functions {/r} reT 
of sources that can be reconstructed at the sinks of syj can also 
be reconstructed at the sinks of 9^2 can also be reconstructed 
at the sinks of 3V2. Here, each function /,, for (61, is a 
function of the information sources that are available at source 
nodes. Subnetworks s\£i and 9(2 are equivalent if £Yj C 9(2 and 

When deriving upper and lower bounding networks, it is 
desirable to find upper and lower bounding networks that have 
the same topologies. In this case, we can bound the difference 
between the capacity of a network 9\[ and capacities ^.(5Vj) 
and ^ (9{u) of lower and upper bounding networks 9{j and 9Q 
using a bound from [11]. Note that by having identical graphs, 
we also require that all links have non-zero capacity in both 
networks. 

For comparing two networks 9{j and 9d, which have iden- 
tical topologies, define the difference factor between 9\Q and 

9[ ll as 

A(^0=max^l (5) 

where C e (9(i) and C e (9\[ ll ) denote the capacities of the link e 
is 9(i and 9d, respectively. Note that A(9(j,9{ 1 i) > 1. Let !Rj 
(%,) denote the capacity region of 9(j Then 

3(iC}(.C^ (6) 

while 

*M Q A(9Vy,5\6,)^- (7) 

IV. Basic simplification operations 

One of the simplest operations for deriving an upper- 
bounding network for a given network is merging nodes. 
Coalescing two nodes is equivalent to adding two links of 
infinite capacity from each of them to the other one. This is 
precisely the approach employed in cut-set bounds. Because 
of these infinite-capacity links, combining nodes, unless done 
wisely, potentially can result in very loose bounds. However, 
we show that in some cases, nodes can be combined without 
affecting the network capacity. One simple example is when 
the sum of the capacities of the incoming links of a node v 
is less that the capacity of each of its outgoing links. In this 
situation, the node can be combined with all nodes w such 
that (v, w) G £ . 

Another possible operation for getting upper or lower 
bounding networks is reducing or increasing the link capac- 
ities. As a special case of such operations, one can reduce 
the capacity of a link to zero which is the same as deleting 
the link. In some cases reducing/increasing link capacities is 
helpful in simplifying the network. 

Another type of operation for simplifying networks is based 
on network cut-sets. A cut P between two sets of nodes W\ 
and W2 is a partition of the network nodes V into two sets 
Vc\ and V2 such that C V\, %>2 C O^- The capacity of a 
cut is defined as the sum of capacities of the forward links of 



the cut, i.e. links (v,w) such that v G V\,w € l^. Links (v,w) 
such that v £ ^2,w € are called backward links of the cut. 
For example, if we find a minimum cut separating a sink from 
its corresponding sources and all other sink nodes, and connect 
the forward links directly to the sink node while preserving all 
the backward links, this results in an upper-bounding network. 
If instead of keeping the backward links, we delete them, a 
lower-bounding network is obtained. In the case where there 
are no backward links, this procedure results in an equivalent 
network. We can of course repeat this procedure for every 
sink. 

Another simplification operation involves removing a set 
Si of links or components and possibly replacing it with 
additional capacity that might be spread over the remaining 
network. A simple lower bounding network can be obtained 
by removing a set SI, while an upper bounding network 
can be obtained from replacing a set Si by adding sufficient 
capacity to the remaining network to be able to carry any 
information that could have been carried by the set SI. For 
example, if the remaining network contains paths from the 
inputs to the outputs of the set SI, we can formulate a linear 
program, based on generalized flows, to find the minimum 
factor k by which scaling up the capacities of the remaining 
links uniformly gives an upper bounding network 1 . Since the 
lower bounding network obtained by just removing the set 
SI differs from the upper bounding network by the scaling 
factor k, this gives a multiplicative bound of k — 1 on the 
potential capacity difference associated with the upper and 
lower bounding operations. 

V. Y-NETWORKS AND GENERALIZATIONS 

Consider the network shown in Fig. 1 consisting of four 
nodes and three directed links with capacities (n,^,^). This 
topology is probably the simplest network in which nodes are 
sharing resources to send their information. We will refer to 
such a network as a Y-network Y(r\,r2,r?,). 

Now consider the network shown in Fig. 2 which consists 
of two Y-networks with shared input and output nodes. The 
following lemma shows that in some special cases this network 
is equivalent to another Y-network. This simplification reduces 
the number of links by 3 and the number of nodes by 1 . 

Lemma 1: Consider the network shown in Fig. 2, ityj, when 
a = aa, b = ab and c = ac. This network is equivalent to 9(2, 
a Y-network F((l + a)a, (1 + a)b, (1 +a)c). 

Proof: Clearly, a Y-network F((l + a)a, (1 + a)b, (1 + 
a)c) is an outer bound for the network of Fig. 2. Hence, we 
only need to show that it also serves as an inner bound. 

For the rest of the proof assume that a is a rational number 
(If it is not rational, it can be approximated by rational 
numbers with arbitrary precision). 

Consider a code of block length n that runs on network ?V2. 
The middle node maps the n(l + a)a bits received from x\ 

1 One way to think of this is to associate a commodity with each link or 
path segment in PI. Conversions between commodities take place according 
to the link capacity ratios in PL. The linear program minimizes k subject to 
flow conservation of these commodities. 
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Fig. 1. A Y-network 

and the «(1 + a)b bits received from X2 to n(l +a)c bits sent 
to node y. 

In order to run the same code on 5Vi, consider using the 
network m times, where m is chosen such that am /(l + a)n 
and m/{\ + a)n are both integers. Note that since a is rational 
by assumption, it is always possible to find such m. Let k\ = 
am/ (I +a)n and ^ = m/{\ +a)n. 

During these m channel uses the intersection node at the 
left hand side receives ma bits from x\ and mb bits from X2. 
This is equal to the bits received by the intersection node 
in 9V2 during ma/ (I +a)an = ^2 coding sessions. Therefore, 
using the code used on 5V2, these bits can be mapped into 
&2«(1 +a)c = mc bits that will be sent to y. Similarly, the 
number of bits received by the intersection node on the right 
hand side during m channel uses is equal to the bits that would 
have been received by the intercession node on £Y2 during k\ 
coding sessions. 

■ 

Lemma 1 serves as a useful tool in our network simplifica- 
tions. For an example of how to employ this result, consider 
the network shown in Fig. 3. This network can be considered 
as a combination of two overlapping Y-networks. 
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Fig. 2. 2 Y-networks with shared source and sink nodes and separate relay 
links 

Lemma 2: Let P = If pa + (1 - p)c < d, then the 

network shown in Fig. 3 is equivalent to a Y-network Y(a,b + 
b',c). 

Proof: Clearly a Y-network Y(a,b + b' ,c) is an upper- 
bounding network for the network of Fig. 3. We show that if 
the constraints in the lemma is satisfied, it also serves as a 
lower-bounding network. 

To find a lower bounding network, consider breaking the 
links in Fig. 3 into parallel links as in Fig. 4, where a = 
a\ + 02 + 03, b = b\ + b2 + bj, etc. The network contains two 
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Fig. 3. Two nodes communicating with one sink node via two relay nodes 

capacity-disjoint Y-networks as illustrated in Fig. 5. Our goal 
is to combine these two Y-networks by applying Lemma 1, 
and in order to be able to do this, we require a% = d% = Ua\, 
b\ = ab\ and c\ = d\ = £|. The combination of these two 
Y-networks will be a Y-network Y((l +a)a u (l + a)b u (l + 
a)c\) which is a lower-bounding network for our original 
network. Now choosing b\ = b, b\ = b' and a = from the 
link capacities constraints, we should have 

(1 + — )a\ <a, 
b 

(1 + T )ci <c, 
a 

^-ai+ci<d. (8) 
b 

From these inequalities, if pa + (1 — p)c < d, we can choose 
a\ = (1 — p)a and c\ = (1 — p)c and get a lower-bounding Y- 
network Y(a,b + b',c). 




Fig. 4. Breaking the links in Fig. 3 into parallel links 



In order to get a better understanding of the required 
constraint stated in Lemma 2, consider the following special 
cases: 




Fig. 5. Breaking the network in Fig. 3 into two Y-networks 
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Fig. 6. Generalization of the network of Fig. 3 



i. b < b' ->■ d > a, 

ii. b = b' d > sj£, 

iii. b^> b' ^ d >c. 

Again consider the network shown in Fig. 3 where all 
the links have capacity 1 except for the link of capacity d. 
From Lemma 2, for d > 0.5 x 1 +0.5 x 1 = 1, this network 
is equivalent to a Y-network r(l,2, 1). Our proof approach in 
Lemma 2 does not say anything about the case where d < 1. 
It might be the case that even for some values d < 1 , still this 
equivalence holds. As we show through an example this cannot 
happen, and for d < 1 the Y-network of 7(1,2, 1) is a strict 
upper bound for our network. Assume that b\ and (^2,^3) 
are available at x\ and xi respectively, where bj G {0, 1}. The 
goal is reconstructing bib2 +b\t>2 + bj, at node y, where all 
operations are in GF(2). This can be done easily in the Y- 
network 7(1,2, 1), but is impossible in the original network 
for d < 1 . 

Fig. 6 shows a generalization of the network of Fig. 3, where 
instead of 2 intermediate nodes, there are k + 1 intermediate 
nodes. Let oco = 1, OC; = bt/bo, for i G {!,..., k}, 



1 + I a,- 

(=i 



and 



1 + I a,- 



By extending the proof of Lemma 2 to this more general case, 
we get Lemma 3. 

Lemma 3: If, for i £ { 1 , . . . , k}, 



i-l k 

V a.jC\ + a j a i < dj. 

.7=0 j=i 



(9) 



then the network shown in Fig. 6 is equivalent to a Y-network 

k 

Y(a, £ /3,-,c). 

i=0 

Another possible generalization of a Y-network is shown in 
Fig. 7. Here, while the number of relay nodes is kept as two, 
the number of source nodes is increased. For this network, we 
can prove Lemma 4 with straightforward extension of Lemma 
2. 

Lemma 4: For i = {2, . . . ,k}, let 



Then, if 



d>£fta + £(l-Pi)e, 

i=i i=i 



(10) 



the two intermediate nodes can be combined without changing 
the performance. 




Fig. 7. Another generalization of the network of Fig. 3 

Again consider the network shown in Fig. 3, and assume 
that d < pa + (1 — p)c. As shown in the previous section, a 
Y-network Y(a,b + b',c), 9b,, serves as a strict upper bound 
for the network of Fig. 3. In order to get a lower bounding 
Y-network, we reduce the capacities of the links a and c by a 
factor 8, such that d = pSa + (1 — p)8c. Hence, 

p fl + (l-p)c' 

and from our assumption < 8 < 1 . Using this, we can again 
invoke Lemma 2 and get a lower-bounding Y-network of 
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Fig. 8. A pair of upper and lower bounding networks for the network of 
Fig. 3. 



(8a,b + b' ,dc) denoted by 9\Q. Comparing the link capacities 
of the upper and lower bounding Y-networks, their difference 
factor is A(9{j,9{ u ) = 8. If d <€. P« + (1 - P)c, then 8 < 1, 
meaning that the bounds become very loose in such cases. 

To solve this problem, consider another possible pair of up- 
per and lower bounding networks shown in Fig. 8, which have 
a topology different than a Y-network. Here the assumption is 
that d < c. It is easy to check that these are indeed upper 
and lower bounding networks. For deriving the upper-bound, 
the incoming information from links a and b are assumed 
to be transmitted directly to the final node, and since the 
incoming capacity of the final node is c, the information sent 
to it from link b' can be captured by a direct link of capacity 
min(/3 / ,c). For the lower bound, since d <c, all the information 
on link c can be directed to the final node. By this strategy, 
the remaining unused capacity of link c is c — d which can 
be dedicated to link b' . If min(c — d,b') = b' , then c <d + b', 
then the upper and lower bounding networks coincide, and we 
have an equivalent network. The more interesting case is when 
c> d + b', and therefore min(c — d,b') =c — d. In this case the 
difference factor of the upper and lower bounding networks is 
at least 1 —d/c. Choosing the best bound depending on the 
link capacities, given a,b,b' and c the worst difference factor 
is 



minmaxj- ; rr— 

d 1 pa + (l-p)c 



l-t} = C - . 

c c + pa + (l-p)c 



(11) 



As an example, for the case where a = b = b' = c=\, the worst 
case difference factor is 0.5 which corresponds to d = 0.5. 
This means that choosing the best pair of bounds for different 
values of d, the difference factor of our selected pair is always 
lower bounded by 0.5. 

We conclude this section by discussing how the approach in 
the section generalizes to a larger class of network topologies. 
Consider the network £tyj shown in Fig. 9. A Y-network 
Y(Y, a iiT l bi,'E l c i) is always an upper bound for the network 
9{x- On the other hand, if we can show, as in the proof of 
Lemma 2, that rtyj contains two capacity-disjoint Y-networks 
of the form y(oc£a;,oc£&,-,a£c,-) and Y((l - a)£a,, (1 - 
°0L^;> (1 ~ °0£ c i)> men ^(E a i)E^i)E c i) i s a l so a lower 
bound for, and thus equivalent to, s\6 ■ Subfigures (b) and (c) 
provide two simple examples of networks where this is the 
case. This construction can also be generalized by replacing 
the basic T-shaped topology with star-shaped topologies with 
arbitrary numbers of inputs and outputs. 




(b) Example 1 (c) Example 2 

Fig. 9. A family of components that can be replaced with an equivalent 
component. The labels represent the link capacities, which satisfy a = a\ + 
ai + .. .a n , b = b\ + b% + ... b m , c = ci +ci + ■ ■ ■ o, and < /■ < 1. 



VI. Effect of link capacities 

Consider two networks Hi and Hi which have identical 
topologies and link capacities except for some link e which 
has capacity C e \ in Hi and capacity C e % <C e \ in Hi- Let 
%x and Kj2 denote the set of achievable rates on Hi and Hi 
respectively. The question is how this difference affects the 
performances of these two networks. One way of doing this 
comparison is based on what was mentioned earlier, i.e., to 
compute the ratio between C e ,i and C e .2- However, this might 
not always give the best possible bound. The reason is that it 
might be case that while C e .i and C e .i are both small compared 
to the capacity region of the networks, A(H,Hi) =C e ,i/C ej 2 
is very large. In this section, we study this problem in more 
details. 

Note that the link of capacity C e .\ in network Hi into two 
parallel links of capacities C e .\ ~C e n and C e 2- Clearly this 
process does not affect the capacity region of Hi- By this 
transformation, network Hi is equivalent to this new network 
with link of capacity e = C e i — C e \ being removed. Therefore, 
in the rest of this section, instead of changing the capacity of a 
link, we assume that a link of capacity e is removed as shown 
in Fig. 10, and prove that at least in some cases changing the 
capacity of a link by e cannot have an effect larger than e on 
the set of achievable rates, i.e., if the rate vector R is achievable 




Hi Hi 

Fig. 10. Networks 5Vj and 9{i which are with and without link e respectively. 



on Hi, rate vector R el, where 1 denotes an all-one vector 
of length \s\, is achievable on Hi as well. 

One such example is the case of multicast networks. In that 
case, the capacity of the network is determined by the values 
of the cuts from the sources to the sinks. Therefore, since 
removing a link of capacity e does not change the values of 
the cuts by more than e, the capacity of the network will not 
be affected by more than e. 

Another example, is the case where all sources are con- 
nected directly by a link to a super-source node which has 
therefore access to the information of all sources. Without 
loss of generality, let S = {1,2, . . . , \s }. As before, assume 
that each sink node t € T is interested in recovering a subset 
of sources denoted by p(f). 

Theorem 1: For the described network with a super source- 
node and arbitrary demands, removing a link of capacity e can 
change the capacity region by at most e. 
Proof: 

Assume that the rate vector R = [R\ , R2, . . . , R\ s 1) is achiev- 
able on Hi- Since in the single source case, capacity regions 
corresponding to zero and asymptotically zero probability of 
errors coincide [12], we can assume there exist a coding 
scheme of block length n that achieves rate R on Hi with 
zero probability of error. 

Based on this zero-error code, we construct another code 
for network Hi that achieves rate R — el with asymptotically 
zero probability of error. 

By our assumption about the network structure, the super 
source-node observes a message vector M = (Mi, . . . ,Mi$i), 
where M s G {1,2, . . . ,2" R '}, for s G {1,2, . . . , \s |}. 

Now consider the link e = (vi,V2) in network Hi which 
has been removed in network Hi- During the coding process 
on H\, the bits sent across this link can take on at most 
2«e differed values. Consider binning the message vectors 
M = (Mi,M 2 ,...,M| 5 |) into 2" £ different bins based on the 
bit stream sent over this link during their transmission. Since 
the code is a deterministic code, each message vector only 
corresponds to one bin. Since there exist 2"^ sesRs distinct 
message vectors, based on the Pigeonhole principle, there will 
be at least one bin with more that 2"^- ses Rs ~ £ ) message vectors. 
Denote the message vectors contained in this bin by the set 

In Hi, no message can be sent from vi to vi through link e. 



Therefore, in order to run the code for jyj on network 9(2, we 
need to specify the assumption of node vi about the message 
that it would have received from node vi in ftyj. Let node V2 
assume that it always receives the bit pattern corresponding 
to the bin containing 5Vfo- Making this assumption and having 
the rest of 5Y2 to perform as in syj, it is clear that all message 
vectors in Mq can be delivered with zero probability of error 
on 5V2 as well. In other words, if the input to the super source 
node in 5Y2 is one of the message vectors in Mq, then each 
sink t <ET recovers its intended message MpM with probability 
one. In the rest of the proof we show how this set Mq can be 
used to deliver independent information to different receivers 
over network 9(2. 

Define random vector U = (Ui,U2,---,Ui s i) to have a 
uniform distribution over the elements of Mq. For each input 
vector U, each sink node f, recovers Up( f ) perfectly. 

The described model with input U, and ouputs Up(,), for 
t E T is a deterministic broadcast channel (DBC) 2 whose 
capacity region is known. Therefore, we can employ this DBC 
to deliver information on 9(2- 

Before doing this, we slightly change the set of sink nodes, 
and replace the set of sinks 1 by <T e as described in the 
following. This modification does not affect the functionality 
of the network, but simplifies the statement of the proof. 
Divide each sink node t into |p(f)| sink nodes, such that each 
one has access to all the information available to the node t, 
but is only interested in reconstructing one of the sources. Let 
1 e denote this expanded set of sinks. Consider a subset 1 s of 
size \s I of T e such that each source s 6 S is recovered by one 
of the sinks in 1$- Since each sink in <T S only recovers one 
source, hence there should be a one-to-one correspondence 
between the elements of S and 1 S . 

Now consider the DBC with input U and outputs {U t } te q- S . 
Since the code is zero-error, and there is a one-to-one cor- 
respondence between the elements of S and 1 S , {Us] ses can 
be replaced by {U s } ses . The capacity region of this DBC, as 
explained in Appendix A, can be described by the set of rates 
(n,r 2 ,...,r\ s \) satisfying 

I> s </7(f/*), (12) 

sen 

for all A C S ■ From our construction, 

H(U s )=H(U h U 2 ,...,U lsl ) 

e). (13) 

ses 

On the other hand, for each ACS 

H(U s )=H(U Jl )+H(U s \ sl ). (14) 

2 DBCs and their capacity regions are briefly described in Appendix A. 



Therefore, 

H(Ux)=H(U s )-H(U sV ) 

>«(£ R s -e)- £ H(U S ) 

ses ses\x 

>«(£/?,.-£)- £ nR s 

ses ses\x 

= «(£ R s -e). (15) 

sen 

It is easy to check that the point (r\,r2, . . . ,i"\s\) = re(R— el) 
satisfies all inequalities required by (12). Hence, using the 
network 9(2 as a DBC, the rate vector R — e can be transmitted 
to nodes in 1 S . 

We now argue that the described DBC code, with no extra 
effort, delivers the rate vector R — £ on network 9(2 to all sinks, 
not just those in T s . The reason is that for each message vector 
M g Mq, and consequently for each input U, all sink nodes in 
1 e that are interested in recovering a source s, i.e., for all t £ 1 e 
such that p(f ) = ,s, receive M s with probability one. Hence, if 
by the described coding scheme rate R s is delivered to one of 
them, then the rest are able to receive the same data stream at 
rate R s as well. ■ 

For some simple cases of multi-source multi-demand case 
networks, for instance when the link of capacity e is directly 
connected to one of the sources, the same result still holds, 
i.e. removing that link cannot change the capacity region by 
more than £. However, for the general case, it remains open 
as to how much removing a link of capacity £ can affect the 
capacity region of the network. 

VII. Cycles and delays 

In [13], the capacity of a channel is defined in terms of 
bits per channel use. In the case where there are no cycles, 
this definition is equivalent to defining capacity in terms of 
bits transmitted per unit time. However, we do not know 
whether in a general network with cycles and delays, these 
two definitions, i.e., bits per channel use versus bits per unit 
time, could result in different capacity regions. For example, 
consider two networks 5\6 and 9(2 that are identical except 
for a single component cycle, illustrated in Fig. 11. In 9(2 the 
transmission delay from vi to V2 is larger than in 9[j due to the 
added node vo, assuming that each link introduces unit delay. 
Now, we do not know whether achieving capacity on 5\£i could 
require interactive communication over a feedback loop, where 
each successive symbol transmitted by V] depends on previous 
symbols received from V2 and vice versa. If we try to run the 
same code on 5V2, the number of symbols per unit time that 
can be exchanged by nodes vi and V2 is decreased because 
of the additional delay introduced by node vo. Hence, if the 
rate is defined in terms of bits communicated per unit time, 
this additional delay will reduce the capacity region. However, 
if the capacity is defined in terms of bits communicated per 
channel use, by letting each node wait until it has received 
the information it requires to generate its next symbol, the 



(a) Component of a/j 



(b) Component of fA£z 



Fig. 11. Changing the delay between two nodes by introducing an extra 
node 



delivered rates and consequently the capacity region will not 
be affected. 3 

In most of the operations introduced in this paper, the 
number of hops between nodes is different in the original 
network compared to its simplified version. Therefore, such 
operations in a cyclic graph with delay can potentially change 
the capacity region in ways that are not predicted by our 
analysis. Hence, in this paper we have restricted ourselves 
to the case of acyclic graphs. However, studying the effect of 
these operations in a general network with cycles remains as 
a question for further study. 

VIII. Conclusions 

In this paper, we proposed new techniques for efficiently 
approximating or bounding the capacity of networks with 
complex topologies and arbitrary communication demands, 
such as non-multicast and functional demands. We proposed to 
take a new approach based on systematic graph operations that 
can be applied recursively to simplify large networks, so as 
to facilitate the application of computational bounding tools. 
Besides its generality, another motivation for such a recursive 
graph-based approach is that it lends itself to tractable "divide- 
and-conquer" algorithms for analyzing very large networks 
and allows computation to be traded off against tightness of 
obtained bounds according to the extent of simplification. 

Techniques proposed for networks of directed noiseless 
point-to-point links (bit pipes) can be readily applied to 
networks of noisy multi-terminal channels by using the results 
of Koetter et al. [9] to replace each noisy link with a bounding 
model consisting of such bit pipes. However, it may be 
possible to obtain better bounds by developing simplification 
tools that are directly applicable to noisy networks. Thus, we 
will seek to extend the above work to networks containing 
noisy broadcast, multiple access and interference links. 

APPENDIX A 

Deterministic broadcast channel 

Deterministic broadcast channels (DBC) are spacial cases 
of general broadcast channels. In a /f-user DBC, 

P((Y 1 ,...,Y K ) = (y l ,...,y K )\X=x)G{0,l}. 

In other words, since in a BC the capacity region only depends 
on the marginal distributions [13], a Abuser DBC can be 

3 Note that in the case of multicast, since it is known that capacity-achieving 
codes do not require such communication over feedback loops, the capacity 
region remains unchanged under both definitions, even in the case of cyclic 
graphs. 



DBC 



— Yk-i =h-i(X) 
-^Y K =f K (X) 



Fig. 12. Deterministic broadcast channel 

described by k functions (f\ , . . . ,_/>) where 



(A-l) 



and Yi=fi(X) for i G {1,2,. ..,£}. In (A-l), X and <Ti refer 
to the channel input alphabet and the output alphabet of the 
! th channel respectively. 

The capacity region of a £-user DBC can be described by 
the union of the set of rates (R\,R2, ■ ■ ■ ,Rk) satisfying 



E^HfoJ.V* C {!,... ,k}, 



(A-2) 



for some P(X) [14], [15] . 
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